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Abstract 

This paper presents a procedure to identify the open-loop system when it is operating under closed- 
loop conditions. First, closed-loop excitation data are used to compute the system open-loop and 
closed-loop Markov parameters. The Markov parameters, which are the pulse response samples, 
are then used to compute a state space representation of the open-loop system. Two closed-loop 
configurations are considered in this paper: The closed-loop system can either have a linear output 
feedback controller or a dynamic output feedback controller. Numerical examples are provided to 
illustrate the proposed closed-loop identification method. 


Introduction 

The problem of identification of the open-loop system when it is operating under closed-loop 
conditions is considered. This is a problem of considerable practical importance. There are several 
instances when this is needed. For example, consider the case when an open-loop model of the 
system is required, but the system is operating in closed-loop, and it is not possible to remove the* 
existing controller for open-loop identification, liven when it is possible to remove the existing 
controller for open-loop identification, it may not be desirable to do so. This is the case when the 
open-loop system is only marginally stable or unstable, and the existing controller is needed to 
ensure overall system stability. An open-loop model of the system may be required for purpose of 
analysis or controller re-design. It is generally not possible to identify the open-loop system 
simply by measuring the system output and the actual input during closed-loop operation because 
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such input is usually not rich enough for identification. Additive input excitation during closed- 
loop operation is necessary to identify the open- loop system. However, the excitation must be 
added in such a way that it does not affect overall system stability that is provided by the existing 
controller. 

The paper considers the following closed-loop identification problems: First, the identification of a 
system having an existing linear output feedback controller is formulated. This is a basic case, 
upon which several extensions can be made. Second, if the open-loop system has a direct 
transmission term, the mathematical problem becomes slightly more complicated, and this case is 
treated next. Third, a solution to the more general problem where closed-loop system has output 
feedback dynamics is presented. Fourth, since the open-loop system may include known input 
and/or output filters in addition to the plant, it is sometimes desirable to extract the plant dynamics 
alone. Mathematically, this is the case of recovering the dynamics of one system from the 
combined dynamics of two cascading linear systems when the other system is known. Finally, 
numerical examples are provided to illustrate each of the developed identification procedures. 

The closed-loop identification method developed here is based on the concept of an observer. Of 
importance are certain basic algebraic relations between the Markov parameters of the observer, 
and those of the closed-loop and open-loop system. The use of Markov parameters in system 
identification is discussed in Ref. I . The observer concept has been used previously in developing 
several open-loop identification techniques. 2 * 8 Even though the closed-loop system identification 
method developed in this paper is derived within a deterministic framework, the resultant 
identification equations have the same structure as those developed previously for observer/Kalman 
filter identification (OKID). The readers are referred to Ref. 4 and Ref. 7 for an investigation of the 
stochastic properties of identification equations possessing this structure in the presence of process 
and measurement noises. From the identified open-loop system Markov parameters, a state space 
realization of the system is obtained by the Eigensystem Realization Algorithm OERA), Ref. 10. 
In the presence of noises, a variance based confidence criterion for ERA identified modal 
parameters is developed in Ref. 1 1 . 

In this paper, the output feedback dynamics is assumed known. This requirement makes the 
problem mathematically well-posed. If feedback dynamics is not known, then the feedback signal 
is required to be known, which is the case treated in Ref. 1 2 for a closed-loop system possessing a 
full state feedback structure. 
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Problem Statement 


Consider a linear multivariable system expressed in state space format as 

x(i + \) = Ax(i) + Bu(i) 

y(i) = Cx(i) (1) 

where jc (/)g /?’,«(/) e i.e., n denotes order of the system, q is the number of 
outputs, and m is the number of inputs. The system has an existing linear output feedback 
controller with a gain F. For purpose of identification, an additional excitation v(t') is injected to 
the control input, and the total input to the closed-loop system becomes 

u(i ) = Fy(i) + Gv(t') (2) 

which yields the following system of the form 

x(i + 1) = (A + BFC)x(i) + BGv(i) 

y(i) = Cx(i) {3) 

For simplicity, let A denote the closed-loop system matrix, 

A c = A + BFC (4) 

The additive excitation input vector Gv(t') and the corresponding output of the closed-loop system 
y(i) are known. The existing linear feedback gain F is assumed to be known. See Fig. 1 for a 
schematic diagram of the closed-loop system. The objective of the problem is to obtain a state 
space model of the open-loop system, denoted by the set (/t, B, C), from input-output data of the 
closed- loop system. 

Furthermore, this is to be accomplished by first obtaining the Markov parameters of the open-loop 
system, Y{i) = CA'~ x B. A state space model of the system can then be computed from these 
Markov parameters using a realization method. Ref. 10. Subsequent developments that treat 
several extensions of this basic problem will be considered. 
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Fig. 1 : Schematic diagram of the closed-loop system 


Mathematical Formulation 

The mathematical formulation consists of the following developments. The input-output 
description of the closed-loop system is described in terms of an observer whose Markov 
parameters can be computed from closed-loop data. Algebraic relations between the Markov 
parameters of the observer and those of the closed-loop and open-loop system are derived. From 
these relations, the open-loop system dynamics can be recovered from the computed observer 
Markov parameters and knowledge of the feedback gain. For clarity of presentation, the 
formulation is done first for the case without a direct transmission term, then extended to the case 
with a direct transmission term. This is because inclusion of the transmission term at the 
beginning would complicate the algebra without altering it fundamentally. Also, the case of the 
closed-loop system with a linear output feedback controller is treated first. The case with a dynamic 
controller then follows. Further extensions to the situation when the open-loop plant includes 
input or output filters are considered. 

I. The Closed-Loop System and Its Associated Observer 

This section introduces the concept of an observer as a intermediate step in solving for the Markov 
parameters of the open-loop system. First, note from Eq. (3) that the additive excitation signal v(i) 
does not affect the overall closed-loop system stability that is being provided by the feedback 
controller since it does not alter the existing closed loop system matrix Ac = A + BFC. To solve 
for the Markov parameters of the closed-loop system in Eq. (3), an observer is introduced to this 
set of equations. This is accomplished by adding and subtracting the term Afy(i) to the right hand 
side of the state equation in Eq. (3), 
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x(i + 1) = A;X{i) + BGv(i) + My(i ) - My(i ) 
= (4 + MC)x(i) + BGv(i) - My(i) 


( 5 ) 


Define the following quantities 


4 = 4 + MC 


B=[B, - M] , 



( 6 ) 


Then the original closed-loop system can be expressed as 

X (l + 1) = + 6 z(i) 

y(i) = Cx(i) (7) 

It has been shown in Ref. 3 or 5 that the above operation is equivalent to introducing an observer 
to the system if the state x(i) is considered as an observer state, and the matrix M can be 
considered as an observer gain. In this particular case, it is an observer of the closed-loop system 
given by Eq. (3). It is important to note at this point that one does not have to know M explicitly at 
the beginning, but rather it will be specified implicitly through the stability requirement for 
\ = Ac + MC. Assuming zero initial conditions for x(i), the input-output description of the above 
system is 


y(i) = ^CA c ^-'Bz(t) 

T— 0 


( 8 ) 


If the system is made asymptotically stable by having a matrix Ac such that the Markov parameters 
CAfB , CA c p *'B, CA c p+2 B, ... can be neglected for some p, then at time steps i>p , the input- 
output description can be approximately described by a reduced set of p Markov parameters 
CB, CA c B, ..., CAf 'B. The freedom in M can be used to make the observer equation stable by 
placing its poles. Various cases where the prescribed poles may be real, complex, or deadbeat are 
studied in Ref. 5, and more extensively in Ref. 8. In the case where M is a deadbeat observer 
gain, the input-output relation of the above system can be expressed in terms of a finite set of 
observer Markov parameters as 
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( 9 ) 


y(/)=£f c (r)z(/- t) 

T=1 


where the observer Markov parameters Y c (i), i = 1, 2, p, are defined as 

YA) = CAi~ l B (10) 

and Y c (i) = 0 for i = p + 1, p + 2, .... Suppose that a set of N measurements of the closed-loop 
system y(i) and u(i), i = 0, 2, .... N-\, given in Eq. (3) is available. Assuming zero initial 
conditions for the moment, the input-output relation for the set of measurements can be written in 
matrix form as 


where 


y=Y c V 


y = [y(l) y(2) ••• yip) y(p + 1) ••• y(N - 1)] 
Y c =[CB CAB ... CAf 'B] 

z(0) z(l) ••• z(p-l) z(p) ••• z(N - 2) 

z(0) ••• z(p- 2) zip — 1) - ziN- 3) 

• • • « 

z( 0) z(l) ••• ziN-p- 1) 


( 11 ) 

( 12 ) 

(13) 

(14) 


From Eq. (11) the set of observer Markov parameters of the closed-loop system given in Eq. (3) 
can be solved for provided that the additive excitation is sufficiently rich such that the Gv(i') rows 
in V have full rank. The least-squares solution to the observer Markov parameter matrix Y c is given 
as 


Yc=yV + (15) 

where (.) + denotes the pseudo-inverse of the quantity in the parentheses. 

For non-zero initial conditions a somewhat different equations must be used. The appropriate 
replacement equation for Eq. (1 1) is simply 
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y, = Y c v, 


(16) 


where the truncated output matrix y, and the truncated input matrix V, are given as 


and the solution for Y e is 


y,=[y(p) y(p + 0 - y(N- 1)] (17) 


zip- 1) 

zip) 

ziN- 2) 


zip -2) 

zip- 1) — 

ziN- 3) 

(18) 

z(0) 

z(l) 

ziN-p- 1) 



.^1 

II 

V: 

+ 


(19) 


The quantities y, and V, are obtained from y and V by simply deleting their first p -1 columns, 
respectively. This makes use of the fact that A* s 0 for i > p, and the effect of the non-zero initial 
conditions can be neglected after p times steps. 


Similar to the analysis in Ref. 4, the number of observer Markov parameters characterized by the 
integer p, that are to be identified must be chosen such that pq > n, where n is the order of the 
system and q is the number of outputs. If p observer Markov parameters are identified, then the 
maximum order of a system that can be realized is pq. Next, algebraic relations between the 
identified Markov parameters of the observer and those of the closed-loop system are described in 
the following. 

II. Relations Between Observer Markov Parameters and Closed-Loop System 
Markov Parameters 


Using the materials developed in the previous section, the observer Markov parameters of the 
closed-loop system can be computed from closed-loop data. This section shows that from the 
observer Markov parameters, the Markov parameters of the closed loop system can be recovered. 

Define £(i) = [i; (,> (/) S? 2 > (i)], where Y c w (i) and Y c m (i) are of dimensions qxm and mxm, 
respectively. The Markov parameters of the closed loop system defined as 
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( 20 ) 


Y c {i) = CK'B 

= C(A + BFC)‘~ X B 


can be recovered from the observer Markov parameters Y c (i) according to the following relation 


Y e (i)=Y c il \i)+^Y e m (T)Y c (i-t) (21) 

t—\ 


where Y e (i) = 0 for i^p. In matrix form, the above recursive equation can be written as 


' / 

'YAiy 


~Y C °\ 1)' 

Y c (2 \l) / 

Y c ( 2) 


n (,) ( 2> 

Y c w ( 2) £ (2) (1) / 

Y c ( 3) 

= 

Y c °\ 3) 

£ (2 >(i-i) n (2, (i- 2 ) ... n <2> (0 /. 

Y c (/)_ 


.i^O). 


The matrix on the left hand side of Eq. (22) is square and full rank, thus for a given set of observer 
Markov parameters Y c (i), the closed-loop system Markov parameters Y c (i ) can be uniquely 
determined. The derivation of this convolution relation between the Markov parameters of the 
closed-loop system and those of its observer is analogous to the development presented in observer 
identification of Refs. 3-5, hence its proof is omitted. 

III. Relations Between Open-Loop and Closed-Loop System Markov Parameters 
with a Linear Output Feedback Controller 

Recall that the primary purpose of the problem is to compute the Markov parameters of the open- 
loop system. Sections I showed that from closed- loop data, the observer Markov parameters of 
the closed-loop system can be computed. Section II showed that from the observer Markov 
parameters, the Markov parameters of the closed-loop system can be found. This section will 
show that the Markov parameters of the open-loop system can be recovered from knowledge of the 
Markov parameters of the closed-loop system and the controller gain. 

First, the first Markov parameter of the closed-loop system is the same as the first Markov 
parameter of the open-loop system, i.e.. 
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r(i) = r c (i) = cfi 


(23) 


Next, consider the closed-loop observer Markov parameter Y c ( 2) 

Y c ( 2) = C(A + BFC)B 
= CAB + CBFCB 
= Y( 2) + Y c (\)FY{\) 


(24) 


from which the open-loop system Markov parameter Y( 2) is simply, 

Y(2) = Y c (2)-Y c (\)FY(l) (25) 

Similarly, the open-loop system Markov parameter K(3) can be recovered by considering the 
closed-loop Markov parameter K f (3), 

Y c O) = C{A + BFC) 2 B 

= CA 2 B + CBFCAB + C(A + BFC)BFCB (26) 

= YO)+YA\)FY{2) + Y c {2)FY{\) 


which yields 


K(3) = K,(3) - Y C {\)FY{2) - Y C (2)FY{\) (27) 

By induction, the relationship between the Markov parameters of the closed-loop system given in 
Eq. (3) and those of the open-loop system given in Eq. (1) is a weighted convolution sum, with 
the weighting matrix being the closed-loop gain F. In general, this expression is written as 


Y(i) = Y c (i)-^Y c (T)FY(i-t) 

X—] 


(28) 


for i = 1, 2, 3, .... The above recursive equation can be written in matrix form as 
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( 29 ) 


■ I 

'Y(\Y 


no)' 

YAW l 

Y{ 2) 


YA 2) 

YA2)K YAW l 

Y( 3) 

= 

YA 3) 

YAi-W YAi~2)K - YAW /_ 



Ui). 


Each product Y c (i)F is a <7 x Q square matrix. The left-hand side matrix in Eq. (29) is square and 
full rank. This implies that the open-loop system Markov parameters can be uniquely recovered 
from the closed-loop system Markov parameters by this method. 

IV. Closed-Loop Identification of System with Direct Transmission Term 

In the basic problem considered in Sections I-III, the system description does not contain a direct 
transmission term. In identification and control of flexible structures, accelerometers are often 
used as measurement sensors, which will introduce a direct transmission term in the state space 
model. Identification of such systems in the closed-loop is slightly more complicated. Consider a 
state space model with a direct transmission term D, 

x (i + 1) = Ax(i) + Bu(i) 

y(i) = Cx(i) + Du(i) (30) 


where again jr(i') e /?", y(i) e R u(i) e R m . The input equation given in Eq. (2) in this case is 


«(/) = Fy(t) + Gv(i) 

= FCx(i) + FDu(i) + Gv(i) 


(31) 


The closed-loop system dynamics can be derived as follows. First, from Eq. (31), the controller 
input can be expressed as 


u(i) = (I- FD )"' FCx(i) + (/- FD)~ X Gv(i) (32) 

provided that the inverse (/ - FD)~' exists. Using Eq. (32) in Eq. (30) yields the following set of 
closed-loop dynamics equations describing the relationship between the excitation Gv(/) and 
output y(0 


1 0 



x(i + 1) = [a + B(l - FD)' FC]x(i) + B{l - FD)"'Gv(i) 
y(i ) = (/ - DF)' Cx(i) + (/ - DF)' DCv(i) 


( 33 ) 


provided the inverse (/ - DF) 1 exists. To derive the observer equations for the above system, 
add and subtract My(i) to the right hand side of the state equation in Eq. ( 33 ) 

x (/ + 1) = 4*0) + B c Gv(i) + My(i) - My(i) 

= A : x(i) + B c Gv(i) + M[Cx(i) + Du(i)\ - My(i) 

= ( A + MC)x(i) + MDu(i ) + B c Gv(i ) - My(i) ( 34 ) 

= (Ac + MC)x(i) + MD[Fy(i) + Gv(i)] + B c Gv(i) - My(i) 

= ( A + MC)x(i) + ( B c + MD)Gv(i) - M(1 - DF)y(i) 


For simplicity of notation, the set of observer equations to be used for identification is 

x (i + 1) = A c x(i) + B c z(i) 
y(i) = Cx(i)+Du(i) 

where 


( 35 ) 


4 = A + MC , A = ^ + B c FC , B c = B(l - FD) 


- r ! rGv(i)] 

B C =[B C + MD -M(l-DF)] , z(i)= I 


-1 


( 36 ) 

( 37 ) 


The input-output description of the above system with zero initial conditions is 


;-i 


yiO^CM'BM + DuiO) 


T=0 


( 38 ) 


Let M be a deadbeat observer gain, then the input-output relation can be expressed as 

y(i) = ^YAr)z(i-t)+Du(i) 


( 39 ) 


Writing in matrix form, the closed-loop observer Markov parameters are related to set of input- 
output data by the following equation 



where 


y = [>(0) y(l) y( 2) — yip) y(p + 1) ••• y(N - 1)] 


Y C =[D CB c C\B c ••• CAT' B^ 


r-(0) 


v = 


«( 1 ) U( 2) 
z(0) z(l) 
z(0) 


w(p) «(P + 1) 

z(p - 1) z{p) 

zip- 2) z(p-l) 


m(/V -1) 
z{N -2) 
z(N - 3) 


z(0) z(l) - z(yv-p-l) 


(41) 

(42) 


(43) 


Equation (42) can be used to solve for the closed-loop observer Markov parameters. The solution 
is given in Eq. (15), with the exception that the output and input matrices are now given in Eq. 
(41) and Eq. (43), respectively. If the initial conditions are not zero, then the truncated version of 
the corresponding output and input matrices are 


V,= 


Vi = [yip) 

yiP+ 1 ) 

- yiN-\)] 

(44) 

u(p) 

U(p + 1) 

— u(N - 1) 


zip- 1) 

zip) 

— z(yv-2) 


zip- 2) 

zip- 1 ) 

•" z(N- 3) 

(45) 

ziO) 

z(l) 

— z(N-p- 1) 



The observer parameter matrix is the same as in Eq. (42). Again, in order to be able to solve for 
the observer Markov parameter matrix Y c , the rows of Gv(i) in z(i) must be full rank. Also, the 
number of observer Markov parameters characterized by the integer p, that are to be identified, 
must be chosen such that pq^n. 


The next step is to show that the open-loop system Markov parameters 



Y(i) = CA'~'B, i = 1, 2, p, p+ 1, ... 


(46) 


can be recovered from the identified observer Markov parameters 

Y c (i ) = CAT'fic = [C* w ( B c + MD) , - C4T'M(/ - DF)] , I = 1, 2, .... p (47) 

and __ 

Y c (i) = 0 , / = p + l, p + 2, ... (48) 

Define the first and second partitions of Y c (i) as 

Y} X) (i) = CAr\B c +MD) 

= C[A + B(l - FDY 1 FC + MC\\B{I - FD )' x + MD\ (49) 

Y c m (i) = -CK~ X M(1 - DF) 

= -C[A + B(l- FD)' 1 FC + jV/C] ‘ M(I - DF) ( 50 ) 

The direct transmission term is identified directly, 

D = Y C ( 0) (51) 

From Y c (i) the Markov parameters sequences Y c (i) = CAY'B c , i = 1, 2, ..., p , p + 1, ... can be 
computed from the following recursive equation 

no*> = n (,, (o + X n <2) (r)(/ - df)-’ no - *) (5 2) 


where K c (0) = D and Y c (i) = 0, i = p + 1, p + 2, .... The Markov parameters T c (i), 

no) = C/C'ft = C(/l + B c FC)‘~'B c (53) 

computed above, have the same structure as the Markov parameters Y c (i) given in Eq. (20) where 
B a = B(l - FD)'' now plays the role of B. Therefore, the open-loop system Markov parameters 
Y(i) = CA‘-'B can be computed from K c (i) = C(A + B c FC)‘ B c as 

1 3 



( 54 ) 


Y(i) = YM)(I ~ FD ) - £ Y c (t)FY(i - t) 

T— 1 


V. Closed-loop Identification of System with a Dynamic Feedback Controller 

In this section, the identification of the open-loop model from a closed-loop system having an 
existing dynamic feedback controller is considered. Consider again a system in state space 
representation. 


x(i + \) = Ax(i) + Bu(i) 

y(i) = Cx(i) + Du(i) (55) 

where x (i)eR*, y(i)eR ", u(i)eR”. A dynamic feedback controller is used to control the 
system which for closed-loop identification is excited according to 

s(i + 1) = Ps(i) + Qw(i ) + v 2 (i) 

g(i) = Rs(i) + Sw(i) (56) 

where s(i) e R % , #(i) e R n , w(i) e R q . The scalar n s denotes the order of the dynamic controller, 
which in general is less than or equal to the order of the open-loop system, n,<n. The dynamic 
controller interacts with the system via 


y(0 = w(i) 
mO) = A , (0 + v,(i) 

The vector quantities v,(i) and v 2 (i) denote the additive excitation signals for closed-loop 
identification. First, the closed-loop dynamics is derived. The input to the system can be 
expressed as 


u(i) = Rs(i) + Sw(i) + v, (i) 

= Rs(i) + Sy(i) + Vi (/) 

= Rs(i) + 5[Cjc(i) + Du(i)] + v,(i) 


from which the input u(i) can be expressed as 



K(0 = (/ - SD)'[Rs(i) + SCx(i) + V,(|)] 


(59) 


provided that the inverse (/ -S£>) 1 exists. Substituting Eq. (59) into the state equation in Eq. 
(55), and the controller state equation in Eq. (56) yields 

x(i + 1) = Ax(i) + B(l - SDY'[Rs(i) + SCx(i)+ v,(/)] 

= [A + B(1 - SD)'' SC].x(0 + [B(I - SD )~‘ R]s(i) + [fi(/ - SD)" 1 ]v, (i) (60) 

and 

*0 + 1) = Ps(i) + Q[Cx(i) + Du(i)]+ V 2 (i) (61) 

= Ps(i) + QCx(i) + QD(l - SD)-'[Rs(i) + SCx(i) + v,(/)] + v 2 (t) 

= [QC + QD(I- SD)' 1 SCptO) + [P + QD{1 - SD)~' /?]*(/) + [QD{I - SD)~' ]v, (/) + v 2 (t) 


Equations (60) and (61) can be combined in matrix form as 


(62) 


'xd+iy 


.vO + l) 



A + B(l - SD)~ SC 
QC + QD(I -SD) ' SC 


B(I-SD) 

P + QD(I-SD) 




B(I-SD)- 

QD(l-SD) 


0 

/ 


’Mi)' 

v 2 (0 


Recall that 


u(i)= Rs(i) + Sy(i) + v,(i) 
*0 + 1) = Ps(i) + Qy(i) + v 2 (/) 


One can write Eq. (63) and Eq. (64) together in a matrix form as 


u(i) ' 

*(| + 1) 


S 

Q 


P I- v 0)J + [v 2 (/) 


(63) 

(64) 


(65) 


Furthermore, the system output equation and the controller state equation can be combined into a 
single matrix equation. 



OTjcOT 

/*J_.v(0_ 


+ 


D 0T u(i) ' 

o ojL^o+i) 


1 5 


( 66 ) 



In the following, a procedure is developed to solve for the Markov parameters of the open-loop 
system from the Markov parameters of the closed-loop system when the dynamics controller is 
known. Define the following augmented system characterized by the matrices 9 


1 — 
o 

O 


C 01 I'D 01 S R' 

[o oj’ Ba 

i 

, c„ = 

o /J ’ Da_ [° °J ’ Fa ~ Q P. 


(67) 


and the following augmented state, input, output, and excitation vectors 


*„(/) = 


w 

_v(i)J ’ 


u a (i) = 


u(i) 

s(i+\) 



( 68 ) 


Making use of the definitions above, Eq. (65) and Eq. (66) become, respectively. 


u a (i) = F a y a (i) + v a (i) 

(69) 

yM) = C a x a (i) + D a u a (i) 

(70) 


Furthermore, define a matrix X a to be 


( l-SD )"' 0 

QD{I-SDY' I 


(71) 


It can be verified by direct substitution that the following identities hold 

A + B(I-SD)~'SC B(l-SDy'R 1 
QC + QD(I -SDY'SC P + QD(I -SDy'Rj “ 


(72) 


B(I - SDy' 
QD{l-SDy' 



X. 


/ -DS 
-QD 


or 

/ 


= (l-F a Dj' 


(73) 


(74) 
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Using these relations, the set of equations describing closed-loop dynamics becomes 


x a (i + 1 ) = [A a + B a (l - F a Dj' F a C a \x a {i) + B a (I - F a DJ 1 v.(i) 
y.(i) = (/ - D a F a y'C a x a (i) + {l - D a F a y'D a v a (i ) 


( 75 ) 


where the first equation in Eq. (75) is obtained by direct use of the identities in Eqs. (67) in Eq. 
(62), and the second equation is obtained by substituting Eq. (69) into Eq. (70) and solving for 
y„(i) provided that the inverse (/ - D a F a )~' exists. As before, the additive excitation does not 
affect the overall system stability that is provided by the dynamic feedback controller. Comparing 
Eq. (75) to Eq. (33) reveals that the augmented system for the closed-loop dynamic controller has 
the same form as the following system 

x a (i + 1) = A a x a (i) + B a u tt (i) 

y a (i) = C a x a (i) + F>aU a (i) (76) 


with an output feedback law for «,(/) given in Eq. (69), that includes an excitation term v a (/). The 
observer equations for the augmented system can be derived by adding and subtracting the term 
M a y a (i ) to the state equation in Eq. (75), 

x a (i + 1) = A^Xaii) + B ac v a ( /) + M a y a {i) - M tt y a {i) 

= A ac x a (i) + B^vM) + M a [C a x a (i)+ D a u a (i)] - M a y a (i) 

= (4* + M a C a )x a (i) + M a D a [F a y a (i) + v a (/)] + fi ac v a (i) - M a y a (i) ^ 

= (4* + M a C a )x a (i) + + M a D a )v a (/) - M a (l - D a F a )y.(i ) 


The set of observer equations to be used for identification is simply 

x a (i + 1) = A a x a (i) + B a z(i) 
y a (i) = C a x a (i) + D a u a (i) 


(78) 


where 


Age — A n + M„C a , Aac — A a + B ac F a C a 


B ac =B tt (I-F a D tt ) 1 
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(79) 



B„=[B« + M a D a - M a (l-D a F a )] , z fl (i) = 


(80) 


The observer Markov parameters for the system given in Eq. (75) are 


Y ac (0)=D„ 


(81) 


Y ac (i) = C a A i -'B x =[C a A i ac '(B ac + M a D a ) , -C a A^M a (I -D a F a )\ , / = 1, 2, .... p (82) 


Assuming zero initial conditions, the observer Markov parameters can be solved from 


v = Y V 

Jr a • ac w a 


(83) 


where 


y. =b«(0) 

y,( i) 

y a ( 2) ••• y a (p) 

y a (p+ 1) 

- y.W-l)] 

(84) 

£ 

= [*>• 

C a B« C.A^B^ 

- C a AL 

l B x ] 

(85) 


'«„( 0) u a (l) 

U a (2) 

u a (p ) «, 

,(P + D 

- u a (N - 1) ' 



z a (0) 

z.0) 

••• z a (p- 1) z, 

Xp) 

••• z a (N -2) 




z a (0) 

••• z a (p- 2) z a 

Xp- i) 

z a (N - 3) 

(86) 




z a (0) 

Z a (l) 

- z a (N-p-\) 



If the initial conditions are not zero, then the truncated versions of y a and V a are to be used. They 
are obtained by simply deleting the first p columns of y a and V a , respectively. In this case, the 
number of observer Markov parameters characterized by the integer p, that are to be identified must 
be chosen such that p{q + n , ) > n + n , . 

As before, define the first and second partitions of Y^U) as 
Y"\i) = C.A i ~'(B ac + M a D a ) 

= C a [A a + B a (l - F a D a y' F a C a + M a C a ]~'[B a (l - F a D a )~ x + M a D a \ 
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(87) 



( 88 ) 


Y± 2) (i) = -C a A‘Z'M a {! - D a F a ) 

= -C a \A 0 + B a (l - F a D a ) ' F a C a + M a C a \ X M a {l - D a F a ) 


The recursive equations for the Markov parameters for Y^Xi) = C a A‘jB a and Y a (i) = C a A'~ l B a for 
i' = l, 2, .... p, p + 1, ... are 


1^(0 = Y<'\i) + X Y?\x){! - D a F tt y x Y x {i - x) 


T=1 


(89) 


Ya(i) = ^(/)(/ - F a D a )~ X YMFJJi - x) 

X~\ 


(90) 


where 1^(0) = ^(O) = D a , and Y ac (i) = 0 for j = p+ 1, p + 2, .... In this procedure, the Markov 
parameters Y x (i) are first computed from the identified observer Markov parameters Y x (i) by 
using Eq. (89). Then, the Markov parameters Y a (i) are computed from the Markov parameters 
fac(0 by using Eq. (90). Finally, it remains to be shown that the open-loop system Markov 
parameters Y(i) can be recovered from the Markov parameters Y a (i). This is simple, since 


Y a ( ()) = 


~K(0) O' 

, YS D = 

'K(l) O' 

Y(i) 

, Y a (i)= / 

O' 

0 0 

0 / 

0 

0 


, 1 = 2, 3, 


(91) 


Thus, the open-loop system Markov parameters Y(0)=D, Y(i) = CA‘ 'B , i = 1, 2, ... are the 
upper left partitions of the computed Markov parameters Y a (i) , i = 0, 1, 2, .... 

V. Identification from Combined Markov Parameters 


In practice, the open-loop system considered in previous sections may actually include the plant 
and the input/output filters. If the dynamics of the open-loop system is known, and the filter 
dynamics is known, then under certain conditions, it is possible to recover the dynamics of the 
plant alone. Mathematically, this is the case of a combined system consisting of two cascading 
linear systems, and the problem is to compute the Markov parameters of one system if the Markov 
parameters of the other system and those of the combined system are known. First, the 
relationship between the Markov parameters of the combined system and those of the individual 
systems need to be derived. Let one system denoted by 
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Xi(i + 1)=M,jc 1 (i) + BiM 1 (i) 
y i (i) = C i Xi(i) + D ] u i (i) 


( 92 ) 


be preceded by another system 


x 2 (i + 1) = A 2 x 2 (i) + B 2 u 2 (i) 
y 2 (0 = C 2 x 2 (i) + D 2 u 2 (i) 


(93) 


where *,(/) e y^Oe/T, ti,(t)e /T, and Jt 2 (/)e /T, y 2 (i)eR q \ u 2 (i)e R m \ Let the 
output of the second system be the input to the first system, i.e., q 2 = m u and 

y 2 (i) = u l (i) (94) 

Then the combined system dynamics is given as 

ac,(/+l) = A,x,(i) + B,u 2 (i) 

>i(0 = C,x,(i) + D,u 2 ii) (95) 


where 


fl,c 2 

fl, = 

B]D 2 

0 a 2 


. B > . 


c,=[c, d,c 2 ] 



(96) 


The relationship between the Markov parameters of the combined system, and the Markov 
parameters of the individual systems is established in the following. 

First, 


K(0) = D, = D\D 2 - y,(0)K 2 (0) 


(97) 


Next, 


K,(l) = C,B, = C,B,D 2 + D,C 2 B 2 
= K,(1)K 2 (()) + K 1 (0)K 2 (1) 


( 98 ) 



Similarly, 


Y i{ 2) — C ,A,B , — C\A\B\D2 + C \B\C 2 B 2 + OjC 2 y4 2 fi 2 

= y',(2)K 2 (0)+y,(i)K 2 (i)+ y,(0)K 2 (2> 


(99) 


y,(3) = C,A]B, = C x A\B x D 2 + C x A x B x C 2 B 2 + C 1 B 1 C 2 A 2 B 2 + d x c 2 a\b 2 
= y,(3)K 2 (0)+ K,(2)y 2 (i)+ y,(i>y 2 (2)+ r,(0)r 2 (3) 


( 100 ) 


By induction, the general relationship is given as 


y,(0= jy.w 2 (i-T) 


T=0 


( 101 ) 


Using this general relationship, under certain conditions, it is possible to solve for the Markov 
parameters of one system when the Markov parameters of the combined system and of the other 
system are known. In particular, the following cases apply. 


If the Markov parameters of the combined system and of system 1 are known, then the Markov 
parameters of system 2 can be solved using the following equations. 

y 2 (0) = [K, r (0)K, (0)]' 1 Y? (0)y,(0) ( 102 ) 


Y 2 (i) = [Y:m l (())]" 


^ ( 0)1 


K,0')-£KiW 2 (i-r) 


i = 1, 2, 


(103) 


T=0 


provided Q\ 1 , and K t (0) = D, has full (column) rank. 

On the other hand, if the Markov parameters of the combined system and of system 2 are known, 
then the Markov parameters of system 1 can be solved according to the following equations. 


y,(0) = y,(0)K 2 r (0)[y 2 (0)Kf(0)]“ 


(104) 


Y 2 «) = 


T=0 


WO-XW^O'-T) Kj C0)[r 2 (0)Kj , 1 = 1,2,... (105) 
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provided m 2 ^ q 2 , and K 2 (0) = D 2 has full (row) rank. 


State Space Realization by ERA 


From the recovered open- loop Markov parameters, a state space model of the system can be 
obtained by the Eigensystem Realization Algorithm, which is outlined in this section. The 
algorithm begins with an r x s block data matrix, denoted by H(i - 1) 


Y(i) Y(i + 1) Y(i + s-\) 

Y(i + 1) Y(i + 2) — Y(i + s) 

Y(i + r- 1) Y(i + r) - Y(i + r + s- 2) 


( 106 ) 


where Y ( i ) = CA‘ 'B, i = 1, 2, ... The order of the system is determined from the singular value 
decomposition of //(()), 


im = UZV T =U,S X V X T (107) 

where the columns of U x and Vi are orthonormal. Si is an n x n diagonal matrix of retained positive 
singular values, and n is the order of the system. Defining aqxrq matrix E] , and an mxsm 
matrix El made up of identity and null matrices of the form 

^ [l*x* O m x(j-|)/n] (108) 

A discrete-time minimal order realization of the system can be shown to be 

A r =Sf m U x r H(l)V x S x - u2 

B r =S x m V x r E m (109) 

C, = E]U X S x m 

This is the basic ERA formulation. To use ERA in the present identification procedure, the entries 
that make up the data matrix given in Eq. (106) are precisely the recovered system Markov 
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parameters Y(i) = CA‘~ x B, i = 1, 2, ... For further details on the algorithm, the readers are 
referred to various references in the literature, e.g.. Refs. 10, 11. 


Numerical Examples 

In this section, several examples are provided to illustrate the identification procedure for closed- 
loop system developed in this paper. Example 1 illustrates the simple case of identifying a system 
with an existing linear output feedback controller. The case of closed-loop identification of a 
system with a direct transmission term is shown in Example 2. Example 3 presents a case with a 
dynamic feedback controller. The system matrices are given here so that the readers can reproduce 
the results. It is the purpose of the following examples to illustrate step-by-step the series of 
computations involved for each of the respective closed-loop case, not the controllers used. 

Example 1: Consider a two-input three-output three degree-of-freedom (sixth-order) mass, 
spring, dashpot system whose discrete system matrices are given below. 


' 0.9691 

0.0154 

0.0001 

0.2120 

0.0014 

0 . 0000 * 


* 0.0232 

0 . 0001 * 

0.0154 

0.9690 

0.0155 

0.0014 

0.2139 

0.0014 


0.0001 

0.0233 

0.0000 

0.0077 

0.9768 

0.0000 

0 .( XK )7 

0.2127 

B = 

0.0000 

0.0000 

- 0.2817 

0.1395 

0.0009 

0.9458 

0.0180 

0.0001 


0.2120 

0.0014 

0.1407 

- 0.2838 

0.1412 

0.0180 

0.9634 

0.0182 


0.0014 

0.2139 

0.0005 

0.0699 

- 0.2122 

0.0000 

0.0091 

0.9544 


0.0000 

0.0007 


(HO) 



*0 

0 

0 

1 

0 

o' 


*0 

o' 

c = 

0 

0 

0 

0 

1 

0 

D = 

0 

0 


0 

0 

0 

0 

0 

1 


0 

0 


The inputs are the applied forces at two of the masses, and the outputs are the three velocity 
measurements. Let the system be stabilized by a linear feedback controller of the form 

u(i) = Fy{i) (111) 


where the feedback gain is given as 
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-0.375 
F = 

0 


0 0 
-0.500 0 


( 112 ) 


For closed-loop identification, the closed- loop be excited by a random perturbation of the system 
output y(i), i.e., 

«(0 = / 7 [>(0 + v ( 0 ] ( 113 ) 

In this case, G = F in Eq. (2). The excitation signal for the second output is shown in Fig. 2, and 
the resultant closed-loop system response for the second output is shown in Fig. 3. 



Fig. 2: Excitation signal for closed-loop Fig. 3: Response of closed-loop system to 
system by output perturbation. excitation signal. 


Using data from the excitation, the observer Markov parameters for the closed-loop system are 
identified. Since the true order of the system is six, and the system has three outputs, the number 
of observer Markov parameters that can be identified is two or greater, i.e., p > 2. For p = 2, the 
identified observer Markov parameters are listed below. 


0.2120 0.0014 

£(1)= 0.0014 0.2139 

.0.0000 0.0007 

'-0.2120 -0.0014 

Y c ( 2 )= -0.0014 -0.2139 

0.0000 -0.0007 


1.8354 

0.0326 

0.0001 

0.0329 

1.8254 

0.0337 

0.0001 

0.0164 

1.9312 


-0.8969 -0.0020 0.0000 

-0.0021 -0.8874 -0.0029 

O.(XXX) -0.0011 -0.9774 


( 114 ) 


(115) 
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The two identified observer Markov parameters completely describe the closed-loop system, from 
which any number of closed-loop system Markov parameters can be computed. The closed-loop 
Markov parameters are the closed-loop system pulse response samples. From the computed 
closed-loop system Markov parameters and the controller gain, the open-loop system Markov 
parameters can be recovered. The open-loop system Markov parameters are the open-loop system 
pulse response samples. The calculation is illustrated here for the first few Markov parameters. 


First, the closed-loop Markov parameters K c (l), Y c ( 2), Y c ( 3), ... are computed using Eq. (21) 


no)=n 0> a)= 


0.2120 0.0014 
0.0014 0.2139 

0.0000 0.0007 


(116) 


r c ( 2 )= n (l) (2)H- n <2> (i)r c (i) = 


0.1771 

0.0081 

0.0000 


0.0081 

0.1776 

0.0042 


K:(3) = F c (2) (1)K c (2) + Y c m (2)Y c (\) = 


0.1353 

0.0190 

0.0002 


0.0190' 
0.1330 , ... 
0.0100 


(117) 


(118) 


where Y c "\ 1), Y c w {\) and K, (1) ( 2), Y™( 2) are the 3x2 and 3x3 partitions of Y c ( 1) and Y e ( 2), 
respectively. Beginning with Y c ( 3), the extra closed-loop Markov parameters are computed by 
setting Y c (0 = 0, <’ = 3, 4, .... Next, the open-loop system Markov parameters F(l), Y( 2), K(3), 
... can be computed using Eq. (28). 


r(l)=Kc(l) = 


' 0.2120 

0.( X )14 


Lo.oooo 


0.0014 

0.2139 

0.0007 


(119) 


0.1940 

0.0084 

0.0084 

0.1995 

0.0000 

0.0043 


( 120 ) 


Y{2)=Y c {2)-Y c {\)FY{\) = 



Y( 3) = YA 3) - Y C (\)FY(2) - Y C (2)FY{\) = 


t * ■ • 


( 121 ) 


0.1648 0.0208 

0.0208 0.1733 
0.0002 0.0106 

In the same fashion, all desired closed-loop and open-loop system Markov parameters can be 
computed from the two identified observer Markov parameters. The obtained results can be 
verified using the open-loop model given in Eqs. (1 10) and the controller gain given in Eq. (1 12). 
This example illustrates the case where the number of observer Markov parameters to be identified 
is chosen to be 2, p = 2 , which is the minimum number for this case. The same result is obtained 
if more observer Markov parameters are identified. The same computation procedure still applies 
with the exception that the observer Markov parameters are now set to zero at a late time step. For 
example, say for p-3, the observer Markov parameters Y c (i) are set to zero for i = 4, 5, ... 


Shown in Fig. 4 is the closed-loop pulse response function of the second-output first-input pair 
obtained from the first 2(X) closed-loop Markov parameters computed from the two identified 
observer Markov parameters. Results for the other input-output pairs are similar although they are 
not shown here. Shown in Fig. 5 is the result obtained from the first 200 open-loop Markov 
parameters that are computed from the 200 closed-loop Markov parameters and the controller gain. 



Fig. 4: Identified closed-loop pulse resp. Fig. 5: Identified open-loop pulse resp. 
(Closed-loop Markov parameters) (Open-loop Markov parameters) 


From the identified open-loop Markov parameters, a state space realization for the system can be 
found via realization theory. 
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Example 2: To illustrate the closed-loop identification problem with the direct transmission 
term, consider the same system in Example 1, with the exception that the direct transmission term 
is now non-zero. 

0.1165 0.0352' 

0.0627 -0.0697 (122) 

0.0075 0.16%, 

The closed-loop system is excited by the perturbing the output signal the same as before. Also, let 
p = 2, the identified observer Markov parameters are listed below. 

*0.1165 0.0352] [-0.0132 -0.0636 1.9199 0.0651 0.0001 

£(0)= 0.0627 -0.0697 £(1)= -0.1239 0.3416 0.0799 1.7616 0.0337 

.0.0075 0. 16% J [-0.0156 -0.0156 0.0059 0.1796 1.9312 

(123) 

'-0.0981 0.0327 -0.93% -0.0191 -0.0000 

Y c {2)~ 0.0613 -0.2826 -0.0256 -0.8531 -0.0029 

0.0074 0.1650 -0.0028 -0.0840 -0.9774 

The direct transmission term D is simply Y c (0) . All open-loop system Markov parameters can be 
computed from K c (l), Y c (2), and the controller gain F using Eqs. (52) and (54). With the direct 
transmission term, however, the computation is slightly more complicated. For purpose of 
illustration, the computation of the Markov parameters CB, CAB, and CA 2 B is shown below. 

First, the closed-loop Markov parameters K,.(l), Y c ( 2), Y c ( 3), ... are computed using Eq. (52) 

" 0.2032 -0.0013' 

K(l) = F e 0) (l)+ £ <2) (1)(/ - DF)~' K c (0) = -0.0053 0.2217 (124) 

-0.0000 0.0007. 

' 0.1702 

Y c (2)=Y c 0) (2)+Y c i2) (\)(l-DF)~ i Y c (\) + Y c i2) (2)(l-DFy l Y c (0)= 0.0028 

- 0.0001 


0.0064 

0.1821 (125) 
0.0043 
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K«(3) = Y™(\)(I -DFY'Y C (2)+ Y c m (2)(l - DF)-'Y C (\) = 


(126) 


0.1302 0.0184 

0.0150 0.1362 , ... 

- 0.0001 0.0104 


where j? 0 (l), f? 2) (l) and Y c °\2), Y c m (2) are the 3x2 and 3x3 partitions of £(1) and £(2), 
respectively, and K c (i) = 0, i = 3, 4, .... Second, the open-loop system Markov parameters are 
computed from the closed- loop Markov parameters above using Eq. (54). One thus obtains 


K(l) = n(l)(/-FZ>) = 


0.2120 

0.0014 

0.0014 

0.2139 

0.0000 

0.0007 


(127) 


Y (2) = Y c (2)(l - FD) - Y C (\)FY (1) = 


0.1940 

0.0084 

0.0000 


0 . 0084 " 

0.1995 

0.0043 


(128) 


YO) = YAW - FD) - YA\)FY(2) - YA2)FY(\) = 


0.1648 

0.0208 

0.0002 


0.0208 
0.1733 , ... 
0.0106 


(129) 


The above identified open-loop Markov parameters can be easily verified by direct substitution. 

Example 3: This example illustrates the case of closed-loop identification with an existing 
closed-loop dynamic controller. Consider the case where the 6-th order system in Example 2 is 
controlled by a 4-th order dynamic controller. The controller matrices are given below. 



" 0.3392 

0.0054 

0.0000 

0 . 0742 " 


" 0.0654 

- 0.0071 

- 0 . 0024 " 


0.0054 

0.3391 

0.0054 

0.0005 


- 0.0335 

- 0.0708 

- 0.0419 

P = 

0.0000 

0.0027 

0.3419 

0.0000 

, Q = 

0.0303 

- 0.0667 

- 0.0402 


- 0.0986 

0.0488 

0.0003 

0.3310 


- 0.0189 

0.0517 

0 . 0452 . 


- 0.0004 

0.0031 

0.0032 

0.00301 

1 " 0.0191 

- 0.0072 

0.0083 " 

R = 

. 0.0040 

0.0060 

- 0.0106 

0.0089 

\- s - 

[- 0.0624 

- 0.0085 

- 0.0134 


(130) 


The closed-loop system is excited by a random perturbation. The time histories of the excitation 
signal v ( (i), v 2 (i), the system input u(i), the system output y(i), and the controller state s(i), each 
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of 100 data samples, are recorded for system identification purposes. Since the dimension of the 
augmented state is n + n, =6 + 4 = 10 , and the dimension of the augmented output is 
q + n, = 3 + 4 = 7 , the minimum number of observer Markov parameters that are to be identified is 
two in the identification algorithm, p = 2. For p- 2, the identified observer Markov parameter 
matrix is of dimensions 7 x 32. From this matrix, any number of closed-loop Markov parameters 
for the augmented system can be computed. For illustration, the first few Markov parameters are 
computed below using Eq. (89). 


Y ac (Q) = Y ac {0)=D a = 


— v(')/ 


-( 2 )/ 



' 0.1165 

0.0352 

0 0 0 

o ' 





0.0627 

- 0.0697 

0 0 0 

0 





0.0075 

0.1696 

0 0 0 

0 




= D a = 

0 

0 

0 0 0 

0 





0 

0 

0 0 0 

0 





0 

0 

0 0 0 

0 





0 

0 

0 0 0 

0 . 





" 0.2124 

0.0019 

0 

0 

0 

0 


- 0.0003 

0.2131 

0 

0 

0 

0 


- 0.0000 

0.0007 

0 

0 

0 

0 

D a F a )' 

II 

© 

'w' 

0.0072 

0.0024 

1 

0 

0 

0 


- 0.0087 

- 0.0034 

0 

1 

0 

0 


- 0.0009 

- 0.0011 

0 

0 

1 

0 


0.0014 

0.0034 

0 

0 

0 

1 


(131) 


(132) 


Using the fact that Mi) = 0, i = 3, 4, ..., the remaining closed-loop Markov parameters of the 
augmented system can be computed as follows. 


Y£\2) + Y™(\)(l 

-D.F.Y' 

MD + fi 2, ( 2)(/- 

D.F.Y' 

M 0) 

' 0.1951 

0.0085 

- 0.0001 

0.0007 

0.0006 

0 . 0006 ' 


0.0040 

0.1984 

0.0009 

0.0013 

- 0.0023 

0.0019 


0.0000 

0.0042 

0.0000 

0.0000 

0.0000 

0.0000 


0.0164 

- 0.0004 

0.3392 

0.0054 

0.0000 

0.0742 


- 0.0100 

- 0.0163 

0.0054 

0.3391 

0.0054 

0.0004 


0.0061 

- 0.0146 

0.0000 

0.0027 

0.3419 

0.0000 


- 0.0047 

0.0117 

- 0.0986 

0.0488 

0.0003 

0 . 3311 . 



( 133 ) 
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Y ac (3) = 

^ 2) (D(/ 

-D.FJ' 

Y c (2) + Y™(2)(l- 

D a F a )'Y x {\) 


' 0.1663 

0.0205 

- 0.0001 

0.0009 

0.0008 

0 . 0009 ' 


0.0142 

0.1718 

0.0009 

0.0017 

- 0.0028 

0.0025 


0.0001 

0.0105 

0.0000 

0.0000 

0.0000 

0.0000 

— 

0.0179 

- 0.0002 

0.1078 

0.0073 

0.0001 

0.0498 


- 0.0101 

- 0.0201 

0.0036 

0.1149 

0.0038 

0.0005 


0.0077 

- 0.0182 

0.0000 

0.0018 

0.1171 

- 0.0001 


- 0.0072 

0.0134 

- 0.0658 

0.0322 

0.0003 

0.1024 


( 134 ) 


Using Eq. (90), the Markov parameters Y a (i ) are then computed. 



0.2120 0.0014 

0 

0 

0 

o ' 




0 . ( X ) 1 4 0.2139 

0 

0 

0 

0 




0.0000 0.0007 

0 

0 

0 

0 
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Y.O) = K«(3X/ - F a D a ) - YMFJA2) - Y x (2)F a Y a (\) = 
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Again, it can be verified that the upper left partitions of ^(O), K a (l), Y a (2), K a (3), ... are the 
open-loop system Markov parameters D, CB, CAB, CA 2 B y ... respectively. 


Concluding Remarks 

This paper develops a procedure for identification of open-loop systems operating in the closed- 
loop. First, the basic problem of identifying the open-loop system with an existing linear output 
feedback controller is formulated. The approach used here is to inject additive excitation during 
closed-loop operation, and closed-loop data is used for identification. The procedure consists of 
two basic steps. First, through an associated observer, the closed-loop system Markov parameters 
are identified. Second, the open-loop system is recovered from the identified closed-loop 
parameters. Relations between the identified observer Markov parameters, the closed-loop system 
Markov parameters, and the open-loop system Markov parameters are established. The basic 
formulation is extended to the case of closed-loop identification of a system with the direct 
transmission term. This case is important since accelerometers are often used as measurement 
devices on large flexible structures. The considerably more complicated case of closed-loop 
identification of a system with an existing dynamic feedback controller is also treated in this paper. 
The developed solution requires perturbation of both the input signal and the controller state for 
identification. Under this condition, it is shown that the identification problem with an existing 
dynamic controller can be formulated to mimic the problem of identification with an linear output 
feedback controller of an augmented dynamic system, which has a simple closed-form solution. 
For the case of two cascading linear systems, it is sometimes possible to recover the Markov 
parameters of one system when the Markov parameters of the other system and those of the 
combined system are known. Numerical examples are provided to illustrate the identification 
procedure for each of the respective closed-loop cases. 
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